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FOREWORD 


This  technical  report  establishes  a  manual  for  collecting  and  analyzing 


food  Intake  data  for  field  and  garrison  assessnents  of  dietary  Intake.  The 


report  discusses  the  entire  sequence  of  events  from  training  of  the  data 


collectors  to  analysis  of  the  data. 
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ABSTRACT 


Assessing  the  dietary  Intake  of  a  military  population  In  the  field  or  In 
a  garrison  dining  facility  presents  many  problems  since  data  collection 
cannot  Interfere  with  the  mission  or  schedule  of  the  soldier,  may  be  done 
under  widely  varying  environmental  conditions,  and  Is  limited  by  the  amount 
and  type  of  equipment  that  can  be  used.  In  response  to  this  challenge,  the 
modified  visual  estimation  methodology  (MVEM)  was  developed  to  meet  all  of 
the  above  constraints. 

This  report  contains  a  detailed  description  of  the  MVEM,  the  standardized 
procedures  for  training  data  collectors  to  be  >90Z  reliable  and  accurate  to 
within  a  tenth  of  a  standard  portion,  and  the  procedures  for  analyzing  the 
nutritional  data  by  computer.  This  methodology  Is  one  of  the  most  reliable, 
accurate,  and  feasible  methods  for  performing  dietary  assessments  of  military 
populations  and  Is  potentially  useful  for  any  mass  feeding  situation.  MVEM 
Is  an  effective  method  for  quantifying  the  dietary  Intakes  of  large  numbers 
of  subjects  with  minimal  Interference  In  terms  of  time  and  subject 
cooperation,  minimum  equipment  needs,  and  widespread  application  to  all  field 
and  garrison  dining  settings.  MVEM  requires  training/ retraining  of  data 
collectors,  analysis  of  training  data  to  determine  the  accuracy  and 
reliability  of  data  collectors,  exaaq>les  of  standard  portions  of  all  foods 
served  at  each  meal,  and  observation  of  food  preparation. 

The  computerized  nutritional  analysis  procedures  require  coding  of  all 
food  Intake  data,  coding  of  all  recipe  preparation  data,  and  analyzing  for 
nutrient  Intake.  Computer  analysis  of  food  Intake  data  Is  not  as  accurate  as 


ch«mlc«l  an«lysls;  how«v«r,  these  values  provide  a  useful  average  for 
population  studies,  do  not  delay  data  processing,  and  Is  relatively 
Inexpensive.  Using  HVEM  and  observing  recipe  preparation  procedures  ln?>rove 
the  accuracy  of  the  nutritional  analysis  Information  for  population  dietary 
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INTRODUCTION 


A.  REQUIREMENT  FOR  METHODOLOGY 

In  1985,  th«  Combat  Flald  Faading  Systam  -  Force  Davalopmant  Test  and 
Experimentation  (CFFS-FDTE)  study  was  conducted  to  evaluate  a  newly  developed 
Combat  Field  Feeding  System’s  capability  to  provide  subsistence  support  to 
the  Army  in  the  field  and  to  evaluate  the  nutritional  adequacy  of  the  rations 
consumed  by  soldiers  in  a  field  envlronaient  (1).  See  Appendix  A  for  list  of 
definitions.  One  objective  of  the  CFFS-FDTE  test  was  to  evaluate  and  conq>are 
nutrient  intakes  of  soldiers  consuming  the  various  CFFS  rations  periodically 
during  the  AA-day  field  test.  The  Military  Nutrition  Division  of  the  United 
States  Army  Research  Institute  of  Environmental  Medicine  (USARIEM) ,  Natick, 
MA,  was  responsible  for  collecting  and  analyzing  food  and  water  intake  data. 
Therefore,  there  was  a  need  to  develop  a  dietary  intake  methodology  that  was 
reliable,  accurate,  and  feasible  in  the  sense  of  minimal  interference  with 
field  training  exercise  and  food  service  activities.  There  was  also  the  need 
to  develop  a  computerized  dietary  data  analysis  system  to  facilitate  rapid 
data  entry,  verification,  reduction,  and  statistical  analyses. 

Quantifying  soldiers’  nutrient  intakes  required  a  dietary  collection 
methodology  that  could  be  used  during  field  training  exercises  to  provide  a 
reliable  and  valid  appraisal  of  soldiers’  dietary  Intakes.  The  advantages 
and  disadvantages  of  various  dietary  collection  methodologies,  i.e.,  2A-hour 
recall,  combination  record  and  recall,  dietary  history,  estimated  record, 
weighed  record,  food  frequencies,  estimating  plate  waste,  etc.  were 


considered.  Large-scale  surveys  of  nutritional  intake  frequently  rely  on  one 


person  in  the  family  to  provide  all  data  through  24-hour  recalls  or  2-  to  3- 
day  recall-record  combinations  because  of  cost  and  response  problems  (2). 
These  methods  usually  do  not  provide  an  accurate  index  of  the  normal  eating 
pattern  because  of  forgetfulness.  Inaccurate  estimations  of  portions  by 
untrained  subjects,  or  changes  in  eating  patterns  because  of  the  burden  of 
remembering  and/or  recording  all  foods.  Burk  and  Pao  (3)  have  published  an 
extensive  review  of  the  procedures  and  problems  in  design,  collection, 
analysis,  processing  and  Interpretation  of  dietary  survey  data  for 
individuals. 

The  accuracy  of  food  diaries  has  been  studied  by  observing  and/or 
weighing  the  food  eaten  and  comparing  this  data  to  that  recorded  by  the 
Individuals  in  their  diaries  (4,5).  In  one  study,  only  50Z  (62/133)  of  the 
individuals  accurately  reported  their  food  intake  but  the  reporting  of  food 
selections  were  accurate  80Z  of  the  tlm  (4).  The  diary  method  significantly 
underestimated  nutrient  intake  per  meal  by  16Z  or  less  (4,5).  Pao  (6) 
reported  that  sien  accurately  remembered  about  85Z  of  what  they  actually  ate 
when  the  24-h  recall  method  was  used.  About  13-14Z  of  the  items  actually 
eaten  were  omitted  during  the  Interview  and  5-7Z  of  the  items  recalled  were 
not  observed  to  have  been  eaten  (6).  Therefore,  the  24-h  recall  and  food 
diary  methods  are  only  80-85Z  accurate.  Studies  (6-8)  have  shown  that 
trained  and  untrained  Individuals  usually  overestimate  portion  sizes  of 
foods.  More  than  50Z  of  the  untrained  people  who  used  estimation  aids 
overestlmatad  by  more  than  50Z  of  the  actual  portion  sizes  (7).  In  contrast, 
Schnakenberg  et  al.  (8)  reported  that  trained  data  collectors  can  estimate 
average  energy  Intake  at  a  meal  with  an  accuracy  of  *  2Z. 


It  is  generally  agreed  that  weighing  o£  foods  served  and  returned  is  the 
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most  accurate  method  of  determining  the  quantity  of  food  eaten  by  an 
individual  (9.10).  However,  weighing  foods  and  keeping  records  can  disrupt 
customary  routines  and  are  time  consuoiing  (3).  The  precision  of  weighing 
foods  is  unnecessary  if  chemical  analyses  of  the  foods  are  not  available  and 
food  composition  table  values  are  used  for  nutritional  analysis.  Burk  and 
Pao  (3)  discuss  the  inconsistency  and  systematic  bias  when  precisely  weighed 
records  of  food  quantities  are  analyzed  with  nutrient  contents  obtained  with 
imprecise  shortcut  oiethods. 


B.  DEVELOPMENT  OF  A  METHODOLOGY 

Since  the  dietary  collection  methodology  had  to  meet  the  minimal 
interference  constraints  imposed  by  the  field  exercise  scenario  yet  still 
provide  a  true  index  of  soldiers'  food  intakes,  a  specific  dietary  collection 
methodology  was  developed  and  tested  during  the  CPFS-FDTE  (1,8).  The  dietary 
methodology  is  a  isodlficatlon  of  the  visual  estimation  Mthodology  described 
by  Lachance  and  others  (9-12).  This  modified  visual  estimation  methodology 
(MVEM)  uses  trained  data  collectors  to  visually  estimate  the  quantity  of  food 
on  trays  before  and  after  subjects  eat.  The  data  collectors  confers  the  food 
portions  to  a  weighed  standard  portion  of  the  same  food.  Using  the  weighed 
standard  portions  which  are  representative  of  portions  actually  served,  data 
collectors  are  trained  to  estimate  the  food  that  is  served  and  returned  to 
the  nearest  0.1  of  a  portion. 

MVEM  is  a  combination  of  the  best  attributes  of  existing  dietary 


■ment  methods.  Trained  data  collectors  and  weighed  standards  increase 
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th«  accuracy  of  cha  dietary  Intake  data  compared  to  recall  methods  which 
depend  on  the  accuracy  of  memoryt  Judgment  of  portion  sizes  of  many  untrained 
subjects,  and  the  skill  of  the  interviewers.  MVEM  reduces  the  burden  on  the 
subject  because  he  shows  his  tray  to  a  data  collector  before  and  after  he 
eats  instead  of  having  to  record  everything  he  eats.  However,  this  method 
does  have  the  drawback  that  some  eubjects  may  change  their  eating  patterns 
^en  observed.  Having  each  subject  weigh  his  food  might  further  Increase 
accuracy  but  greatly  Interferes  with  the  subject’s  normal  routine,  is  time 
consuming,  requires  many  weighing  scales  to  make  large  scale  data  collection 
impossible,  and  is  unfeasible  for  military  field  or  garrison  feeding 
situations. 

Since  the  nutrient  coiiq>osition  of  foods  is  influenced  by  food 
preparation  techniques,  there  was  also  a  need  to  develop  a  procedure  to 
closely  monitor  recipe  preparation.  The  data  from  the  recipe  analysis  are 
used  with  the  food  Intake  data  collected  by  MVEM  to  calculate  quantities  of 
nutrients  consiimed. 

There  are  tw9  options  available  to  an  investigator  when  nutritional 
information  is  desired  for  a  complex  food  comprised  of  multiple  ingredients. 
The  first  option  is  to  sample  that  food  and  to  have  it  chemically  analyzed. 
Chemical  analysis  of  foods  is  expensive  and  time  consuming,  and  thus  Involves 
delay  in  processing  food  intake  data,  but  it  is  unquestionably  the  most 
accurate  method  available.  The  second  option  is  to  rely  on  food  conposltlon 
tables  and  to  calculate  the  resulting  nutritional  profile  from  the  sum  of 
nutrients  in  the  ingredients.  This  option  is  relatively  inexpensive,  would 
not  cause  a  delay  in  processing  food  Intake  data  but  is  randomly  less 


1 

•ccurat*  du«  to  comparability  problams  batwaan  the  £ood  Ingredients  actually 
used  and  those  In  the  food  composition  tables  (13).  Analysis  of  food  Intake 
data  using  food  composition  tables  produces  values  tdilch  are  not  as  accurate 
as  chestlcal  analysis  but  uhlch  are  useful  for  population  studies  (14).  With 
the  advent  of  computerized  access  to  nutrient  database  systems  which  contain 
data  from  food  composition  tables,  cosq>uter  recipe  analysis  Is  an  efficient 
tool  for  the  analysis  of  food  Intake  data  collected  In  dietary  assessments  of 
populations.  The  Digital  VAX  11/780  con^uter  (VAX)  Is  used  with  the  ORACLE 
Relational  Database  Management  System  (ORACLE)  for  nutritional  analysis  of 
the  data. 

Presently,  a  standard  version  of  a  coflq>uterlzed  nutrient  database,  the 
Nutrient  Databank  (NDB),  at  the  University  of  Massachusetts  at  Ainherst,  MA 
(OMASS)  Is  used  to  coiq>ute  nutrient  composition  of  recipes  prepared  In  Army 
dining  facilities.  The  nutrient  data  contained  In  this  Databank  are  from  the 
USDA*s  Database  for  Standard  Reference,  Release  5,  supplemented  with  data 
from  other  food  composition  handbooks,  manufacturers’  analyses,  scientific 
literature,  and  Imputation.  In  the  present  system,  cooking  losses  are 
accounted  for  by  selecting  cooked  Ingredients  and  adjusting  final  water 
percentages.  A  more  sophisticated  NDB  Is  being  developed  idilch  will  allow 
for  correction  of  nutrient  values  for  losses  during  cooking  and  corrections 
of  yields  for  fat  and/or  water  changes. 

C.  PURPOSE  OF  REPORT 

The  purpose  of  this  report  Is  to  provide  a  detailed  description  of  the 
dietary  methodology  which  USARIEM  has  developed  and  refined  since  the  CFFS- 


FDTE  (1)  and  used  in  four  subsequent  studies t  Fort  Riley  end  Fort  Lewis 
Garrison  Dining  Facilities  (15) i  Fort  Sea  Houston  CFFS-Medlcal  (16),  and  Fort 
Devens  Dining  Facility  study  (unpublished).  The  report  Includes  a 
description  of  the  sctlvltles  and  procedures  which  are  utilized  before, 
during,  and  after  dietary  data  collection  Including  a  detailed  users  manual 
for  training  dietary  data  collectors.  The  report  also  Includes  an  evaluation 
of  the  reliability  and  accuracy  of  the  MVEM  for  estimating  portion  size. 
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PRE-DATA  COLLECTION  ACTIVITIES 


A.  COLLECTION  AND  PRE-CODING  OF  RECIPES 

Flgur«  1  contains  a  Flow  diagram  of  the  activities  that  occur  prior  to 
the  start  of  data  collection  for  dietary  assessments  of  field  and  garrison 
feeding.  Vflien  notification  is  received  about  a  study,  a  menu  is  obtained 
from  the  dining  facility  manager  which  details  the  foods  to  be  served  during 
the  study  period.  For  recipes  from  the  Armed  Forces  Recipe  Service  File  TM- 
A12,  a  file  of  recipe  numbers  is  constructed  on  the  VAX,  and  is  read  by  the 
program  GET_RECIPE,  tdilch  searches  files  of  previously  coded  recipes  for 
those  recipe  numbers.  GET_RECIPE  produces  five  fllest  (a)  RECIPE. FIL  which 
contains  all  previously  coded  recipes  (Table  l)t  (b)  a  second  file  containing 
the  codes  of  those  single  ingredient  recipes  found  in  the  ORACLE  table  VSIOLE 
(Table  2),  (c)  a  file  containing  the  codes  of  special  Army  rations  found  in 
the  ORACLE  table  RATION,  and  (d)  a  list  of  the  recipe  codes  that  were  found 
and  (e)  a  second  list  of  those  recipe  codes  that  were  not  found. 

For  those  recipes  which  were  not  previously  coded,  the  program  CODING  is 
employed  to  interactively  code  recipes.  CODING  accesses  an  ingredient  file 
of  names,  NDB  codes,  and  portion  options,  and  allows  for  quick  and  easy 
coding  of  the  most  complex  recipes.  The  list  of  codes  for  all  ingredients 
and  the  quantity  of  that  Ingredient  in  the  recipe  are  automatically  read  into 
a  file  of  coded  recipes  (RECIFE. FIL)  by  the  program.  CODING  can  also  be  used 
as  a  recipe  entry  program,  with  the  actual  coding  being  done  with  a  printed 
version  of  the  above  mentioned  ingredient  file.  The  resulting  recipe  file  is 
appended  to  the  RECIFE. FIL  containing  the  previously  coded  recipes. 
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Table  1.  Sample  of  computer  file  named  RECIPE. FIL. 


RECIPE  L00071  HAM  STEAKS  BKD 

810140  HAM.  CANNED.  ROASTED  3.000  POUND.  AP 

RECIPE  0030  ham  MAC  AND  TOMATO 

ARB012  HAM-CND-CHNK-DRND  lA.  250  POUND 

ARBOOe  PEPPERS-OREEN-DEHY  5.  330  OUNCE 

027010  WATER  .  002  38. 400 

013000  TENDER  MACARONI  4.  500  YLD>  LB. 

804031  SHORTENING.  SOY/COT  1.  000  POUND 

802020  GARLIC  POWDER  1.  000  TEASPOON 

811531  TOMATO.  CND.  WHOLE  19.  160  POUND 

022300  GRANULATED  SUGAR  .  250  CUP 

ARB009  CHEESE-AMER-DEHY  1.  250  POUND 

811540  TOMATO  JUICE  1.  160  QUART 


1360.  8  GRAMS 


7377.  5  GRAMS 
151.  1  GRAMS 
3840.  0  GRAMS 
6660.  0  GRAMS 
453.  6  GRAMS 
2.8  GRAMS 
8691.0  GRAMS 
50.  0  GRAMS 
567. 5  GRAMS 
1127.5  GRAMS 


RECIPE 

L00022  BEEF  STEW 

POUND 

002200 

BEEF  CHUCK  RAW 

3.  000 

024390 

ALL-PURPOSE  FLOUR 

.  200 

CUP 

019630 

SALT 

.  500 

CUP 

802030 

BLACK  PEPPER 

.  200 

TABLESPOON 

802020 

GARLIC  POWDER 

.  167 

TABLESPOON 

804518 

CORN  OIL 

.  200 

CUP 

811531 

TOMATO«  CND.  WHOLE 

1.  200 

CUP 

802042 

THYME  GROUND 

.  100 

TABLESPOON 

802004 

BAY  LEAF 

.  100 

TEASPOON 

811125 

carrots.bld.no  salt 

.  800 

POUND 

811144 

celery.bld.no  salt 

.  400 

POUND 

811805 

BOILED  ONIONS. W/SALT 

.  300 

POUND.  AP 

811367 

POTATO.  FLSH.  BLD.  WO/S 

1.  000 

POUND.  AP 

019630 

SALT 

.  300 

TBSP. 

024390 

ALL-PURPOSE  FLOUR 

.  450 

CUP 

1360.8  GRAMS 
27.  4  GRAMS 
145.0  GRAMS 
1.3  CRAMS 
1.  4  CRAMS 
43.  6  CRAMS 
288.  0  GRAMS 
.  4  GRAMS 
.  1  GRAMS 
362.  9  GRAMS 
181.4  GRAMS 
136.  1  CRAMS 
453.  6  CRAMS 
5.  1  GRAMS 
61.  7  GRAMS 


RECIPE  G026  CHILI  CON  CARNE 

007560  CHILI  WITH  BEANS  1.  000  100.  0  GRAMS 


RECIPE  0009  BEEF  STEAK  AND  GRAVY 

ARB020  BEEFSTEAK-DEHY-RAW  1.  000  POUND  454. 0  GRAMS 
804034  HYDROC.  SOYBEAN  OIL  .400  CUP  87.2  CRAMS 
024390  ALL-PURPOSE  FLOUR  .  600  CUP  82.  2  GRAMS 
ARB006  SOUP-*^AVY  BASE-BEEF  .  BOO  OUNCE  22.  7  GRAMS 
802030  BLACK  PEPPER  •  100  TABLESPOON  .  6  GRAMS 
024390  ALL-PURPOSE  FLOUR  1.  BOO  CUP  246.  6  GRAMS 
WATER  PERCENTAGE  ADJUSTED  TO  »4N»*** 
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Table  2.  Sample  of  computer  file  listing  single  ingredient  recipes. 


02210  1.  CHUCK*  BONELESS.  TRIHMED.  CKO 

02210  1. 

03S50  1.  ROUND  STEAK.  TRIMMED.  CKD  (CHOICE) 
03990  1. 

03702  1.  HAMBURG  (LEAN)  21XFAT.  WELL  DONE 

03702  1. 

03720  1.  BEEF  STEW.  CANNED 

03720  1. 

03810  1.  CHIPPED  BEEF.  CREAMED 

03810  1. 

03940  1.  BEER.  (4.  9X  ALC/VOL) 

03940  1. 

03941  1.  BEER.  LIGHT 

03941  1. 

03990  1.  LIQUOR.  80  PROOF 

03990  1. 

04070  1.  CARBONATED.  GINGER  ALE.  PALE  DRY 

04070  1. 

04090  1.  CARBONATED.  ARTIFICIALLY  SWEETENED 


04090  1. 
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CODMAKER  reads  RECIPE. FIL  and  writes  an  abbreviated  version  called 
studyname.COD  idilch  Is  composed  o£  (a)  the  three-character  access  code, 

(b)  the  £ood  name,  and  (c)  the  standard  weight  (Table  3).  CODMAKER. FOR  can 
also  read  a  studyname.COD  £lle  From  another  study  and  re£ormat  It  £or  the  new 
study.  Having  the  data  collectors  and  data  enterers  use  the  three-character 
access  code  reduces  the  possibility  o£  error  during  coding  and  entry  of  food 
Intake  data.  The  studyname.COD  File  serves  two  purposes.  In  printed  Form  It 
serves  as  a  codebook  For  the  data  collectors,  allowing  them  to  code  each 
subject's  Food  choices  at  each  meal  For  entry  by  the  data  enterers.  The 
studyname.COD  File  also  serves  as  a  resource  File  For  the  data  entry  program, 
translating  the  access  code  Into  the  NDB  code,  and  the  number  o£  portions 
Into  weight  In  grams.  It  Is  helpFul  to  the  data  collectors  IF  the 
studyname.COD  File  Is  as  complete  as  possible  when  the  study  begins. 

CODMAKER  allows  the  recipe  specialist  to  organize  the  original  Foods  In  the 


studyname.COD  File  Into  categories  For  easy  reFerence.  However,  subsequent 
entries  cannot  be  added  to  the  previously  set  categories.  A  studyname.COD 
File  should  be  printed  For  each  o£  the  data  collectors  at  the  beginning  o£ 
the  study  and  as  It  Is  revised  during  the  study. 


B.  TRAINING  IN  THE  MODIFIED  VISUAL  ESTIMATION  METHOD 

To  be  sure  that  the  data  collectors  are  collecting  Food  Intake  data  that 
are  reliable  and  accurate,  they  are  trained  prior  to  the  start  oF  the  study. 
Training  Involves  repetitive  practice  estimating  portion  sizes  For  dlFFerent 
Foods  on  plates,  trays,  and  bowls  (Appendices  B-E).  The  training  program 
consists  o£  six  sessions  administered  over  a  three  day  period  o£  time. 


11 


iC 


Table  3.  Sample  of  a  studyname. cod  file  called  FTSAM.  COD. 


A 

B 

C 

D 

E 

F 

1 

1 

TTT801 

PUDD I NC-CHOCOLATE 

lU  RND  SP 

126.  00 

2 

1 

TTT901 

CHEESE  SPREAD 

MRE  PACK 

43.  00 

3 

2 

TTT102 

BEEF-CREAilED  GROUND 

3  RND  SP 

293.  00 

4 

2 

TTT103 

BACON-CANADIAN  U/BRINE 

3  SLICES 

66.  00 

9 

2 

Tmo9 

SAUSAOE-BRKFST 

96.  00 

6 

2 

TTT201 

PEPPERS-8TUFFED 

378.  00 

7 

2 

TTT202 

HEATB ALLS-SWED 1 8H 

183.  00 

8 

2 

TTT203 

BEEF-SWISS  STEAK 

291.  30 

9 

2 

TTT301 

PORK-ROAST  W/ORAVY 

2.  9  SL 

71.  00 

10 

2 

TTT302 

MEATLOAF  W/ORAVY 

2  SL. .  9SP 

130.  00 

11 

2 

TTT303 

CHICKEN-OOLDEN.  U/ORAVY 

2SL.  ISP 

130.  00 

12 

2 

TTT304 

BEEF  STEW 

3  SPOONS 

300.  00 

13 

2 

TTT309 

HAM  SLICES 

2  SLICES 

93.  00 

14 

2 

TTT306 

BEEF  W  BARBEOUE  SAUCE 

2  SC  SP 

184.  00 

19 

2 

TTT307 

CHICKEN  ALA  KINO 

2  U  RND  SP 

246.  00 

16 

2 

TTT308 

BEEF-ROAST  U  MUSHROOM  ORAVY 

2.  9  SL 

193.  00 

17 

2 

TTT309 

STEAK-PEPPER 

3  SC  SP 

291.  00 

18 

2 

TTT310 

FRANKFURTERS 

2  FRANKS 

99.  00 

19 

2 

TTT311 

LASAONA 

3*4  SO 

291.  00 

20 

2 

TTT312 

TURKEY-SL  U/ORAVY 

4.  9SL.  ISP 

190.  00 

21 

2 

TTT313 

BEEF  TIPS  t  ORAVY 

2  RND  SP 

187.  00 

22 

2 

TTT314 

CHICKEN  CACC 

291.  30 

23 

2 

TTT319 

CHILI 

249.  00 

24 

2 

TTT316 

BEEF-POT  ROAST 

248.  00 

29 

2 

TTT317 

PORK-BBQ 

170.  00 

26 

2 

TTT318 

SPAGHETTI  U/MEATBALLS 

291.  00 

27 

3 

TTTlOl 

EOOS  AND  HAM 

2SL  RND  SP 

190.  00 

28 

3 

TTT106 

EOOS-CHEESE  OMELET 

149.  90 

29 

3 

TTT107 

EGOS-SCRAMBLED 

149.  90 

30 

4 

TTT400 

BEANS-BAKED 

1  HEAP  SP 

160.  00 

31 

9 

TTT104 

BREAKFAST  BAKE 

4*9  SO 

192.  00 

32 

9 

TTT108 

CEREAL-CORN 

170.  00 

33 

9 

TTT109 

CEREAL-GRITS 

170.  00 

34 

9 

TTT200 

RICE-SPANISH 

170.  00 

39 

9 

TTT403 

NOODLES-BUTTERED 

3  HEAP  SP 

248.  00 

36 

9 

TTT404 

MACARONI  ti  CHEESE 

2  HEAP  SP 

290.  00 

37 

9 

TTT407 

RICE-WHITE 

2  HEAP  SP 

188.  00 

38 

9 

TTT700 

BREAD-WHITE.  CANNED 

.  33  CAN 

76.  00 

39 

9 

TTT800 

APPLE  DESSERT 

1  SL  RND 

123.  00 

40 

9 

TTT802 

CAKE-COFFEE 

73.  00 

41 

9 

TTT803 

DESSERT-BLUEBERRY 

194.  00 

42 

9 

TTT804 

CAKE-BLUEBERRY 

79.  00 

43 

9 

TTT809 

CAKE-CHERRY  NUT 

143.  00 

Column  A  “  Three-Character  Access  Code 

Column  B  »  Extra  field  which  may  be  used  to  discriminate  between  food  groups 
or  types  of  rations  (l.e.,  A-,  B-,  and  T-rations) 

Column  C  •  Six-digit  Nutrient  Databank  (NDB)  code 
Column  D  >•  Food  description  or  name 

Column  E  =  Standard  portion  in  household  measurements 
Column  F  »  Standard  portion  weight  in  grams 
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The  •sclmatlons  of  portion  sizes  are  analyzed  for  accuracy  and  reliability 
before  the  data  collectors  start  a  study. 


C.  RELIABILITY  AND  ACCURACY  OF  THE  MODIFIED  VISUAL  ESTIMATION  METHOD 

To  test  the  ability  of  data  collectors  to  estimate  the  same  portion  sizes 
repeatedly,  an  analysis  of  variance  repeated  measures  program  of  SFSSx  was 
used  to  statistically  analyze  the  training  data  and  to  produce  a  reliability 
coefficient.  Reliability  measures  the  extent  to  which  a  test  or  Judge  yields 
the  same  results  on  repeated  trials  (17).  Since  measurement  always  contains 
a  certain  amount  of  chance  error,  unreliability  is  always  present.  However 
repeated  measurements  of  the  same  phenomenon  tend  to  be  consistent  from 
measurement  to  measurement  and  this  phenomenon  is  referred  to  as  reliability. 
The  more  consistent  the  results  given  by  repeated  measurements,  the  higher 
the  reliability  of  the  measuring  procedure;  the  less  consistent  the  results, 
the  lower  the  reliability. 

The  ability  of  the  data  collectors  to  accurately  estimate  portion  sizes 
is  determined  by  subtracting  the  visually  estimated  fraction  of  a  standard 
from  the  fraction  obtained  from  weighing  the  food  sample  (estimate  -  actual). 
The  differences  are  checked  to  ensure  that  the  mean  is  less  than  a  tenth  of  a 
fraction  of  the  standard  portion. 

Criteria  to  select  a  person  as  a  data  collector  are:  reliability  score 
greater  than  (>)  90X  and  mean  accuracy  within  a  tenth  of  a  standard  portion 
size.  Statistical  Information  from  the  training  of  data  collectors  from  A 
studies  are  presented  here:  CFFS-FDTE  Hawaii  (1),  Fort  Lewis  Garrison  Dining 
Facility  (15),  Fort  Sam  Houston  CFFS-Medical  (16),  and  Fort  Devens  Dining 
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Facility  study  ( unpub 1 Ishad ) .  Tha  rallabillty  data  from  these  A  studies  are 
categorized  Into  two  groups  becatise  of  differences  in  the  timing  and  method 
of  collecting  reliability  data  for  each  of  the  above  studies:  (a)  testing 
after  portion  estimation  practice  and  12  days  of  collecting  food  Intake  data 
in  the  CFFS-FDTE  Hawaii  study  (Group  A)  and  (b)  testing  after  2  days  of 
practice  estlioatlng  portion  sizes  for  the  Fort  Lewis  Garrison  Dining 
Facility,  the  Fort  Sam  Houston  CFFS-Medlcal,  and  Fort  Devens  Dining  Facility 
studies  (Group  B). 

Food  Items  for  the  training  wtre  selected  because  of  their  consistency, 
shape,  frequency  served,  and/or  availability.  Foods  were  presented  on 
plates.  In  bowls,  and  with  multiple  foods  per  plate  In  an  effort  to  discount 
nwthod  of  presentation  but  all  data  for  a  specific  food  and  portion  were 
enalyzed  together.  The  subjects  observed  the  portion  sizes  of  the  different 
foods  at  least  three  times  with  5  being  the  most  frequent  number  of  tests. 
Portion  sized  ranged  from  0.1  •  2.S  times  a  standard  portion  for  the  data 
collectors  In  Group  A.  Because  studies  had  shown  that  portion  sizes  greater 
than  1.5  tloMS  a  standard  portion  were  very  Infrequent,  the  data  collectors 
were  only  tested  from  0  to  1.3  times  a  standard  portion  for  Group  B. 


Rellabllltv  of  Data  Collectors 

Data  collectors  In  group  A  were  tested  on  their  ability  to  visually 
estimate  a  portion  size  after  12  days  of  collecting  food  Intake  data  and 
showed  an  overall  reliability  of  98t  in  estimating  fractions  of  portion  sizes 
(Table  A).  Group  B  data  collectors  had  mean  reliability  scores  of  95  and  98X 
with  the  most  frequent  score  being  98X.  Analyzing  reliability  by  food  types 
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shouvd  that  tha  data  collactora  In  tha  FT  Lawls  study  had  nora  troubla 
astloiatlng  portion  slzas  for  rlca  and  chill  with  scoras  of  89  and  82Z, 
raspactlvaly  (Tabla  5).  Tha  rallablllty  scoras  for  all  othar  foods  vara 
graatar  than  90Z. 

Tha  data  for  Group  B  wara  analyxad  to  datarnlna  tha  af facts  of  obvious 
arrors  on  rallablllty  scoras.  Obvious  arrors  wsra  dascrlbad  as  putting  the 
decimal  point  In  tha  wrong  place  (l.a.  2.5  vs  .25) •  mixing  tha  order  of  tha 
plates  of  food,  ate.  Tha  scoras  for  two  Judges  Increased  from  84  to  99Z  and 
from  89Z  to  97Z,  raspactlvaly  when  tha  obvious  error  of  misplacing  decimals 
was  corractad.  Tha  obvious  arrors  wara  not  corrected  whan  determining  tha 
final  rallablllty  scores.  Tha  data  collector  with  a  rallablllty  score  of  84Z 
was  not  used  In  any  of  these  studies  but  due  to  personnel  constraints  tha 
dietary  collector  with  an  89Z  rallablllty  score  was  retained.  This  data 
collector  received  extra  training,  was  given  fewer  subjects,  and  data 
collection  sheets  were  ravlawmd  for  major  Inconsistencies. 


Accuracy  of  Data  Collectors 

Tha  overall  accuracy  of  the  data  collectors,  taken  by  averaging  the  means 
of  the  different  studies,  was  an  underestimation  of  0.03  of  a  standard 
portion  size.  The  mean  accuracy  values  for  the  data  collectors  In  the 
different  studies  are  found  In  Table  6.  The  CFFS>FDTE  Hawaii  data  Indicated 
that  the  major  Inaccuracies  In  estimating  portion  size  occurred  when  portion 
sizes  1.7  times  or  greater  than  the  standard  portion  were  used  (1).  The 
accuracy  of  the  data  collectors  In  estimating  the  portion  sizes  of  different 
food  Items  Is  found  In  Table  7. 


Table  5.  Reliability  (Z)  of  the  modified  visual  estimation  method  in 
estimating  fractions  of  a  standard  portion  for  various  food  items  in 
different  Army  studies. 


POOD  _ STUDY 


Hawaii 

FT  Lewis 

FT  Sam 

FT  Devens 

Bread 1  field  &  end 

98 

Eggs  k  Ham 

99 

Creamed  Beef 

98 

Beef  Stew 

97 

94 

98 

Rice 

98 

89 

96 

95 

Mixed  Vegetables 

97 

9A 

94 

98 

Pineapple,  end 

98 

Pudding,  end 

98 

Potatoes ,  diced 

98 

Baked  Product 

90 

95 

95 

Fluid 

92 

97 

Spam 

93 

Chili 


82 
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Table  6.  Accuracy  of  data  collactors  in  astlmatlng  fractions  of  standard 
portion  sizes  using  the  modified  visual  estimation  method  In  different  Army 
studies  (Mean  *  SD) . 


ACTUAL  STUDY 

PORTION  SIZE  ESTIMATE 


DIFFERENCE 


CFFS-FDTE  (n-12) 
Fort  Lewis  (n>4) 
Fort  Sam  (n*12) 
Fort  Devens  (n*4) 

MEAN 


1.10>0.68 

0.80+0.39 

0.52+0.33 

0.52+0.32 


0.99+0.63 

0.78+0.40 

0.54+0.32 

0.52+0.32 


-0.10+0.27 

-0.02+0.19 

-0.01+0.09 

-0.00+0.07 

-0.03 


T«bl«  7.  Deviation  from  actual  portion  alzas  (aatlmata  -  actual)  of  data 
collactora  uaing  tha  modified  visual  estimation  msthod  to  estimate  portion 
sizes  of  food  Items  In  different  Army  studies  (Mean  +  SD) . 


FOOD 

STUDY 

HAWAII 

FT  Lewis 

FT  Sam 

FT  Devens 

(n-199) 

(n-28) 

(n*72) 

(n-24) 

Field  Bread 

-0.11+0.27 

- 

- 

- 

Eggs  &  Ham 

-0.02+0.19 

- 

- 

Creamed  Beef 

-0.05+0.28 

- 

- 

- 

Beef  Stew 

-0.14+0.28 

e» 

-0.04+0.09 

-0.02+0.06 

Rice 

-0.06+0.30 

0.09+0.18 

0.04+0.08 

0.02+0.10 

Mixed  Vegetables 

-0.21+0.32 

0.12+0.21 

0.01+0.09 

-0.03+0.05 

Pineapple 

-0.18+0.27 

- 

- 

- 

Canned  Bread 

-0.07+0.22 

- 

- 

- 

Pudding 

-0.15+0.22 

- 

- 

- 

Potatoes ,  diced 

0.19+0.24 

- 

- 

- 

Spam 

- 

0.00+0.09 

- 

- 

Fluid 

- 

0.02+0.10 

- 

-0.03+0.09 

Chili 

- 

-0.21+0.16 

- 

Baked  Product 


-0.12+0.09 


0.02+0.07 


0.04+0.04 


Llmlftlon*  of  th«  Modlfl«d  Visual  Eatlnmtlon  ttothod 

0n«  of  th«  major  limitations  of  this  training  program  was  that  it  has  not 
baan  tastad  for  tha  af facta  of  mamory  on  tha  data  collactors*  ability  to 
produca  such  high  raliabllity  scoras.  To  dacraasa  tha  af facts  of  mamory , 
tasting  sasslons  for  tha  data  collactors  wars  spraad  ovar  thraa  days,  tasting 
sasslons  wars  intarsparsad  with  othar  dlstractor  sasslons,  and  larga  numbars 
of  foods  and  portions  wsra  Includad  in  tha  tast  to  siaka  mamorlzation 
difficult. 

A  sacond  llsiitatlon  was  that  tha  data  collactors  ware  not  tastad  for 
raliabllity  ovar  long  periods  of  time.  Testing  was  usually  dona  in  two  to 
thraa  days  because  of  time  and  material  limitations  whereas  most  MND  studies 
extended  ovar  a  two  waak  period.  However,  several  of  tha  data  collactors 
were  retrained  and  retested  over  a  two  month  period  and  their  reliability 
scores  Increased  by  1-2Z.  This  la  not  a  true  test  of  tha  above  problem  but 
tha  stability  of  tha  raliabllity  scoras  over  2  months  and  tha  fact  that  tha 
reliability  scores  were  very  high  for  the  data  collectors  in  the  CFFS-FDTE- 
Hawaii  study  after  12  days  of  practice  indicate  that  tha  variation  in 
accuracy  and  reliability  over  a  two  weak  time  period  might  not  cause  a  major 
discrepancy  in  computing  the  Intake  of  nutrients  in  the  different  studies. 
Since  this  method  is  used  to  obtain  information  on  population  patterns  of 
food  consultation  and  not  for  metabolic  studies,  a  small  difference  in 
raliabllity  scores  is  not  as  critical.  The  CFFS-FDTE-Hawali  study  (1)  shoieed 
that  trained  and  experienced  data  collectors  were  able  to  estimate  the 
caloric  content  of  meals  to  within  2Z  (21  kcal).  A  2Z  difference  in 
raliabllity  probably  would  not  affect  the  final  results  significantly  since 
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variation  In  dally  food  Intaka  La  usually  graatar  than  2Z.  Howsvar  a  study 
naads  to  ba  conductad  to  taat  tha  rallablllty  and  accuracy  of  data  collactors 
ovar  tha  coursa  of  a  study. 


1 


DATA  COLLECTION  ACTIVITIES 


A.  COLLECTION  OF  FOOD  PREPARATION  DATA  AND  DATA  ENTRY 
Coll«ctlon  of  R«c1p«  Data 

This  stsp  starts  with  s  visit  to  ths  tsst  sits.  Flgurs  2  contains  a  flow 
diagram  of  tha  activities  that  occur  during  tha  data  collaction  phase  of  the 
study  at  tha  test  site.  Information  Is  obtained  on  tha  foods,  beverages,  and 
condiments  tdilch  are  offered  each  day.  These  foods  may  or  may  not  be  listed 
on  the  menu  l.e.:  condiments,  type  of  salad  dressing,  salad  bar  Ingredients, 
etc.  but  Information  Is  needed  because  the  soldiers  will  use  these  items 
frequently.  Usually  food  coo^osltlon  data  are  available  for  each  of  these 
Items  and  they  are  coded  as  single  Ingredient  recipes.  A  standard  unit  of 
Bwasure  Is  decided  upon  for  each  of  the  above  foods,  and  an  average  weight  Is 
computed  from  ten  aaiiq>les.  This  average  becomes  the  standard  portion  for 
each  Item,  and  Is  the  unit  which  the  data  collectors  will  use  as  their 
standard  for  portion  estimation.  In  the  case  of  some  of  the  more  difficult 
Items  for  portion  estimation,  such  as  salads  Individually  created  at  the 
salad  bar,  subjects  arc  asked  to  describe  their  selections  In  terms  of  these 
standard  measures.  For  example,  quantities  of  blue  cheese  dressing  are 
<l*scrlbed  In  numbers  of  ladles.  This  Is  an  example  of  the  least  accurate 
estimation.  Standard  weights  and  measures  for  foods  made  from  recipes  which 
contain  nultlple  Ingredients  (rcclped  foods)  are  not  obtained  until  they  are 
encountered  during  the  study.  Standard  foods,  beverages,  and  condiments 

served  each  day  and  which  do  not  vary  In  nutritional  composition 


DATA  COLLECTION  PROCEDURES  WHEN  IMPLEMENTING 
THE  MODIFIED  VISUAL  ESTIMATION  METHOD 
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CODE  AND/OR  ALTER  RECIPES  (CODING) 


ar*  now  coded  as  single  ingredient  recipes  with  recipe  codes  that  correspond 
to  the  UMASS  NDB  codes  and  are  appended  to  the  growing  file  of  coded  recipes. 
Multi- Ingredient  recipes  are  rarely  prepared  exactly  according  to 
specification  and  changes  In  Ingredients  or  their  proportions  will  affect  the 
nutrient  content  of  the  recipe.  Hence,  a  recipe  specialist  observes  food 
preparation  and  documents  actual  quantities  of  Ingredients,  types  of 
Ingredients,  and  cooking  procedures. 

The  kitchen  Is  a  conq>llcated  vnrkplace  with  as  many  as  ten  to  fifteen 
cooks  preparing  different  foods  at  any  one  time.  A  meeting  is  held  with  all 
kitchen  personnel  to  describe  the  purpose  of  the  study  and  the  function  of 
the  recipe  specialist  In  the  kitchen.  A  common  misconception  Is  that  the 
recipe  specialist  Is  an  Inspector  who  Is  checking  compliance  with  recipe  and 
cooking  standards.  This  misconception  interferes  with  the  collection  of  data 
because  It  tends  to  disrupt  normal  kitchen  procedures  as  cooks  try  to  follow 
recipes  scrupulously.  In  fact,  the  sole  purpose  of  the  recipe  specialist  In 
the  kitchen  Is  to  record  the  preparation  of  each  recipe  Item  as  It  Is 
actually  prepared,  with  no  Judgement  as  to  right  or  wrong. 

A  production  schedule  Is  obtained  from  the  head  cook,  detailing  who  Is 
cooking  ^at  and  when.  As  many  cooks  as  possible  are  observed  at  the  proper 
points  In  preparation.  If  the  menu  Is  available  before  the  study  starts,  the 
recipes  are  duplicated  In  advance  so  as  not  to  Interrupt  the  cook’s  routine 
Co  read  the  recipes.  Weights,  or  at  least  volumes,  are  obtained  for  each 
Ingredient  at  appropriate  steps  during  food  preparation  to  Include  final 
yields.  Sartor lus  scales,  which  weigh  to  the  nearest  1/lOth  of  a  gram,  are 
used  to  weigh  Ingredients  and  yields.  Notes  are  taken  on  cooking 


■Mthodologics  \diich  diffsr  from  that  d«8crib«d  on  th«  rsclpc  cards  or  those 
that  require  elaboration.  When  observation  Is  Inposslble,  the  cook  of  that 
particular  Item  Is  Informed  In  advance  and  asked  to  keep  records  of 
weights /volumes  for  retrieval  In  a  later  Interview.  This  kind  of  Information 
Is  considered  unreliable  In  the  best  of  circumstances  and  Is  kept  to  a 
minimum. 

It  may  be  too  disruptive  to  weigh  every  Ingredient  In  every  recipe. 
However »  It  Is  liiq>ortant  to  weigh  the  Ingredients  which  will  have  a 
significant  nutrient  lnqiact.  Always  measure  salt.  Ingredients  with  a  high 
sodium  content,  fats  and  oils,  and  other  Ingredients  which  will  a 'feet  the 
caloric  and  macronutrient  content  of  the  diet.  Final  yields  are  very 
difficult  to  obtain.  It  may  be  necessary  to  weigh  several  serving  pans  of 
food  to  obtain  one  final  weight.  When  the  initial  weights  of  Ingredients  are 
not  available  and  the  full  yield  of  the  recipe  Is  not  recoverable  from  the 
cooking  pot,  yield  weights  will  create  erroneous  correction  factors.  In 
these  cases,  code  a  water  percentage  factor  Into  the  recipe.  It  Is  Important 
to  weigh  all  Ingredients  In  recipes  In  which  the  water  content  changes 
significantly.  If  a  final  yield  weight  Is  obtained.  It  Is  not  necessary  to 
measure  water  used  during  preparation.  Any  difference  between  the  total 
weight  of  non-water  Ingredients  and  the  yield  weight  Is  considered  to  be 
water  unless  the  fat  content  Is  altered. 

Recipe  Data  Entry 


Digital  Professional  350  (FRO  350)  personal  computers  are  taken  on  all 
studies  so  food  Intake  and  recipe  data  can  be  entered  Into  data  files  and 


corrected  as  soon  as  possible.  As  new  recipes  are  encountered,  they  are 
assigned  an  access  code  and  added  to  the  studyname . COD  file  (Table  3).  The 
studyname.COD  file  grows  continually  throughout  the  study.  The  recipe 
specialist  Is  responsible  for  weighing  the  standard  portions  of  food  for  the 
data  collectors  and  manually  entering  the  data  In  the  studyname.COD  file. 
Using  standard  portions  to  Improve  the  accuracy  of  the  MVEM  requires  a 
serving  of  each  food  that  Is  prepared.  Because  dining  facilities  usually 
must  account  for  all  food  servings  and  operate  on  a  tight  budget,  samples  of 
food  that  are  very  close  to  the  standard  weight  are  taken  so  that  excess  food 
does  not  have  to  be  discarded.  Standard  portions  of  foods  which  may  be 
served  at  the  next  meal  should  be  saved  If  the  Intervening  time  will  not 
change  the  volume  of  the  food  l.e.,  salad.  After  weighing  out  the  standard 
portions  of  foods  for  a  meal,  review  the  foods  with  the  data  collectors  and 
give  special  Instructions  l.e.,  separate  portions  for  meat  and  Its  sauce.  If 
an  alternate  food  Item  Is  used  to  replace  a  food  that  has  run  out,  a  standard 
portion  should  be  weighed  out  and  the  data  collectors  notified.  The 
Information  on  the  foods  served  at  the  meal  should  be  entered  In  the 
studyname.COD  file  as  soon  as  possible.  The  data  collectors  use  the  three- 
character  access  code  and  the  conversion  factors  to  code  the  food  Intake 
records  at  the  end  of  the  meal.  The  studyname.COD  file  must  be  updated 
before  the  food  Intake  data  for  that  meal  can  be  entered  Into  a  conq>uter 
file. 

CODING  has  an  edit  option  to  allow  for  alteration  of  pre-coded  recipes  to 
reflect  changes  In  Ingredients  or  their  quantities.  Most  pre-coded  recipes 
require  some  alteration  due  to  deviations  from  the  standard  recipe  during 


preparation.  CODING  also  has  a  dacoda  option  to  allow  the  recipe  specialist 
to  validate  the  coded  recipes  in  the  field  and  thus  allow  izamediate  analysis 
of  recipes  upon  return  to  USARIEM. 


B.  COLLECTION  OF  FOOD  INTAKE  DATA  AND  DATA  ENTRY 
Collection  of  Food  Intake  Data 

Collection  of  food  intake  data  involves  collection  of  three  types  of  data 
from  each  subject:  food  served,  food  not  eaten  (plate  waste),  and  the  extra 
food/meals  that  the  subject  cats  in  places  other  than  in  the  studied  dining 
facility  (outside  food).  The  computer  is  used  to  derive  food  intake  data  by 
subtracting  the  plate  waste  from  the  food  served.  Data  are  collected  at 
breakfast,  lunch,  and  dinner.  At  the  beginning  of  each  meal  the  recipe 
specialist  provides  san^les  of  standard  portion  sizes  of  all  the  foods  that 
will  be  served  for  that  meal. 

After  collecting  their  food  from  the  serving  line,  the  subjects  take 
their  food  selections  to  their  assigned  data  collectors.  The  data  collectors 
visually  estimate  the  portion  sizes  of  foods  on  the  trays  and  the  data  are 
entered  manually  on  Ration  Record  forms  (Appendix  F).  The  subjects  also  are 
interviewed  for  pertinent  information  such  as  food  deposited  in  pockets, 
fluids  consumed  while  waiting  to  be  served,  or  foods  covered  by  other  foods 
(l.e.,  toast  covered  by  creamed  beef),  etc.  (Appendix  E) .  The  pre-meal 
interview  is  limited  to  1-2  minutes  to  ensure  that  the  subjects  do  not  have 
to  eat  cold  food  and  that  their  meal  time  is  not  unnecessarily  prolonged. 

When  the  subject  has  finished  his  meal,  the  tray  is  presented  to  the  data 
collector  for  the  recording  of  plate  waste.  The  post-meal  interview  takes 


3-4  minutes  because  the  subjects  arc  questioned  as  to  whether  they  added  salt 
to  food,  how  much  salt  was  used,  the  distribution  of  the  total  amount  of  salt 
among  the  different  foods  (percentage  distribution),  what  food  was  salted, 
reasons  for  not  eating  a  food,  hedonic  ratings  of  the  foods  on  a  9-polnt 
scale  (l«dlslike  extremely,  9«like  extreawly),  etc. 

Since  attempts  arc  made  to  minimally  interfere  with  the  habits  and  eating 
patterns  of  the  soldiers,  they  are  not  limited  to  eating  all  meals  and  snacks 
in  the  dining  facility  during  the  study.  If  any  foods  are  eaten  outside  the 
dining  facility  or  between  data  collection  periods,  the  subjects  are  asked  to 
record  the  outside  food  data  in  dietary  diaries  (Appendix  F).  The  outside 
food  dietary  diaries  are  reviewed  for  coiiq>leteness  and  accuracy  and  if  errors 
are  discovered  in  the  diaries,  the  information  is  reviewed  with  the  subject 
at  the  next  meal. 


Food  Intake  Data  Entry 

The  food  intake  data  arc  manually  coded  by  the  data  collectors  using  the 
studyname.COO  three-character  access  codes  and  food  names.  If  necessary,  the 
conversion  factors  are  used  to  change  portion  sizes. 

The  food  intake  data  entry  program,  called  ENTRY,  prompts  the  data 
enterer  for  the  food’s  three-character  access  code,  the  nultlple  or  fraction 
of  the  standard  portion  served  and  returned,  the  reasons  for  not  eating  the 
food  (reason  not  eaten),  the  hedonic  ratings  of  each  food  item,  and  the 
amount  of  salt  added  to  each  food  item.  Once  the  food  Intake  data  are 
entered  for  a  meal,  ENTRY  accesses  the  studyname.COD  file.  The  program  keys 
on  the  three-character  access  code  and  writes  a  data  file  containing  the 
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subject  number,  the  dey  number,  the  meel  nusd>er,  the  eccess  code,  the  recipe 
code,  the  food  name,  the  standard  weight,  the  number  of  standard  portions 
served,  the  nuoiber  of  standard  portions  returned,  the  weight  of  food 
consumed,  and  the  percentage  distribution  of  salt  among  the  different  food 
Items.  A  report  file  (Table  8)  Is  generated  by  ENTRY  ^Ich  allows  the  data 
collectors  to  validate  their  W9rk  egalnst  the  original  data. 

Once  a  three-character  access  code  and  standard  weight  are  accessed  by 
ENTRY,  It  becomes  unchangeable  In  the  studyname.COO  file  because  that  same 
weight  must  be  accessible  during  later  validation  and  correction.  Thus,  If  a 
salad  dressing  serving  utensil  Is  changed  In  mid-study,  or  white  cake  appears 
again  and  Che  standard  portion  differs  In  weight  from  the  previous  one,  a 
correction  factor  must  be  calculated  and  applied  to  chose  Iteoa  by  the  data 
collectors  when  they  code.  For  exaople.  If  salad  dressing  ladles  contained 
ISg  and  were  replaced  by  ones  containing  24g,  the  data  collectors  would 
Inquire  about  the  numbers  of  ladles  used.  If  the  answer  were  two  ladles,  the 
data  collector  would  later  multiply  the  two  ladles  by  24/15  or  1.6, 
converting  the  portion  to  3.2  portions  of  the  standard  15g  ladle  listed  In 
the  studyname.COD  file. 

If  an  Incorrect  weight  Is  entered  In  Che  studyname.COD  file.  It  Is 
necessary  to  manually  search  for  that  food  Item  and  correct  all  food  Intake 
data  files  that  contain  that  food.  Some  errors  can  be  corrected  manually 
with  EOT,  others  require  pcogramnlng  changes.  A  consnon  error  affecting 
weight  is  to  Include  unedlble  portions  of  a  food,  such  as  bone,  skin,  seeds, 
etc.  In  the  weight.  Some  recipes  should  not  be  placed  In  the  studyname.COD 
file  as  a  single  recipe  l.e.,  cake  with  Icing  or  meat  with  sauce.  These 
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r«clp«s  should  b«  sspsrstsd  sa  thslr  proportions  vary  dspsndlng  upon  ths  part 
of  tha  caka  from  which  tha  placa  is  cut  or  tha  amount  of  sauca  put  on  meat. 
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C.  VALIDATION  OF  FOOD  INTAKE  DATA 

Tha  data  collectors  validate  their  data  to  be  sura  they  did  not  make 
mistakes  in  collecting  data  and  to  correct  errors  made  by  the  data  enterers 
(Appendix  G) .  The  data  collectors  con^are  the  computer  report  generated  by 
the  data  entry  program  to  the  original  data  collection  sheets.  Mistakes  are 
oiarked  on  the  coiig>uter  report  and  returned  to  the  data  enterers  for 
correction.  Corrected  computer  reports  are  compared  to  the  previous  computer 
report  until  all  siistakes  are  corrected.  Vlhen  a  data  collector  feels  that 
the  data  is  correct,  another  data  collector  examines  the  data  for  accuracy  by 
coiig>aring  the  final  computer  report  to  the  original  data  collection  sheets. 
All  data  are  validated  during  the  data  collection  phase  of  the  study  to  be 
sure  that  errors  are  caught  and  corrected  immediately. 


POST-DATA  COLLECTION  ACTIVITIES 


A.  TRANSFER  OF  DATA  FILES  FROM  PC  TO  VAX 

See  the  flow  dlagrem  In  Figure  3  for  e  summery  of  the  activities  that 
occur  after  the  data  Is  collected,  entered  In  computer  files,  and  validated. 
Since  all  recipe  and  food  consua^tlon  data  on  a  study  are  entered  Into 
computer  files  on  floppy  disks  In  the  Digital  PRO  350  personal  computers,  the 
files  must  be  transferred  to  the  Digital  VAX  11/780  mainframe  coo^>uter  upon 
return  to  USARIEM. 

B.  GENERATION  OF  STUDT  DATABASE 

Once  the  coded  recipe  file  Is  conpleted,  it  Is  sent  over  telephone  lines 
to  UMASS  where  It  Is  read  by  a  program  which  accesses  the  nutrient  database 
and  writes  a  data  file  containing  nutrients  per  100  grams  for  each  food  and 
recipe  used  during  the  study.  A  report  Is  generated  which  describes  the 
nutrients  In  each  recipe  Item  In  units  of  100  grams  and  In  standard  serving 
weight.  These  files  are  retrieved  and  printed  at  USARIEM.  A  dietitian 
reviews  the  nutiltlonal  analysis  and  flags  recipes  with  suspect  nutrient 
values.  The  coded  recipe  Is  rechecked  against  the  original  data  recorded  In 
the  kitchen  and  errors.  If  any,  are  corrected.  The  coded  recipe  file  Is  then 
rerun  and  the  report  file  rechecked.  This  process  Is  repeated  as  many  times 
as  necessary  until  the  data  are  correct.  The  product  Is  a  study  nutrient 
database,  which  Is  loaded  Into  the  ORACLE  database  management  system. 
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C.  ANALYZING  FOOD  INTAKE  DATA  TO  DETERMINE  NUTRIENT  INTAKES 

The  food  Intak*  £11«  idiich  was  ganarated  by  tha  data  collactors  In  tha 
dining  facility  Is  now  read  by  tha  program  ANALYZE.  Tha  program  accesses  the 
study  nutrient  database  to  confute  and  write  to  a  file  the  nutrients 
contributed  by  each  food  consumed  at  each  meal  by  each  parson.  Meal  and  day 
totals  are  ganarated  by  a  statistical  package  (SPSSx).  These  are  closely 
examined  to  locate  nutrient  values  Indicative  of  errors  In  the  original  food 
Intake  data.  If  such  errors  exist,  they  are  corrected  and  the  above  program 
Is  rerun.  This  process  Is  repeated  until  tha  food  Intake  data  Is  accurate. 

The  dietary  assessment  data  Is  statistically  analyzed  by  SPSSx  programs 
and  graphics  ganarated.  The  nutritional  data  can  be  subdivided  or  summarized 
Into  meal  and  day  totals  vary  slowly  by  cooputar.  Exan^las  of  data  reduced 
by  this  system  have  been  reported  elsewhere  (1,15,16). 

D.  ANALYZING  OUTSIDE  FOOD  DATA  TO  DETERMINE  NUTRIENT  INTAKES 

The  outside  food  data  Is  obtained  by  the  data  collectors  on  a  dally  basis 
during  the  data  collection  phase.  The  data  could  be  coded  during  that  phase 
but  due  to  time  constraints  the  outside  food  data  Is  usually  coded  and 
analyzed  during  the  post-data  collection  phase  either  concurrently  or  after 
the  food  Intake  data  is  analyzed.  Figure  4  contains  a  flow  diagram  of  the 
outside  food  analysis  activities.  Outside  food  data  is  coded  as  if  a  dietary 
analysis  Is  being  done  on  the  CYBER.  Using  the  program  CODEXVAX,  the  outside 
food  Items  are  coded  Interactively  and  reclped  foods  which  have  been  analyzed 
previously  are  coded  manually.  The  codes  for  reclped  foods  are  transferred 
to  another  file  since  nutrient  Information  does  not  exist  on  the  CYBER  for 


ANALYZE  OUTSIDE  FOOD  DATA  STATISTICALLY 


these  foods*  The  file  without  reclped  foods  Is  sent  to  CYBER  to  obtain 
nutrient  data  on  the  outside  foods  and  the  nutritional  Information  In  100  g 
portions  Is  retrieved.  The  reclped  foods  file  Is  manipulated  to  produce  a 
’recipe’  file  which  Is  sent  to  the  CYBER  to  generate  another  file  of  100  g 
nutrient  Information  for  each  of  the  recipes.  Both  nutrient  data  files  are 
loaded  Into  ORACLE  and  the  ANALYZE  program  Is  run  to  generate  the  outside 
food  data  for  statistical  analysis. 


SUMMARY 


( 


! 

In  response  to  s  need  for  a  quick,  efficient,  and  minimal  Interference 
methodology  for  collecting  dietary  Intake  data,  the  Modified  Visual 
Estimation  Methodology  (MVEH)  was  developed.  This  report  provides  detailed 
descriptions  of  MVEM,  the  methods  for  training  data  collectors  to  be  reliable 
(>90Z)  and  accurate  (to  within  a  tenth  of  a  standard  portion),  and  the 
procedures  for  analyzing  the  nutritional  data  by  computer.  This  methodology 


Is  one  of  the  most  reliable,  accurate,  and  feasible  methods  for  performing 
dietary  assessments  of  military  populations  and  Is  potentially  useful  for  any 
mass  feeding  situation  l.e.,  cafeterias,  dining  facilities,  colleges, 
hospitals,  and  prisons.  MVEM  Is  an  effective  method  for  quantifying  nutrient 


ll  Intakes  for  large  numbers  of  subjects  with  minimal  Interference  In  terms  of 

I  time  and  subject  cooperation. 

■  Expensive  and/or  extensive  equipment  are  not  required  and  MVEM  can  be 

J  performed  under  all  field  and  dining  facility  conditions.  Standardized 


procedures  have  been  developed  and  are  Included  In  the  appendices  for 
training  data  collectors  to  estimate  portion  sizes  of  foods  served  and 
returned  with  a  reliability  of  greater  than  90Z  and  with  an  accuracy  to 
within  a  tenth  of  a  standard  portion.  MVEM  requires  training/ retraining  of 
data  collectors,  analysis  of  training  data  to  determine  the  accuracy  and 
reliability  of  data  collectors,  san^les  of  standard  portions  of  all  foods 
served  at  each  meal,  and  observation  of  food  preparation. 

The  computerized  nutritional  analysis  procedures  require  coding  of  all 
food  intake  data,  analysis  of  recipe  preparation  data,  and  analyzing  for 
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nutrient  Intake.  The  accuracy  of  any  nutritional  analysis  methodology 
depends  on  the  accuracy  of  the  food  composition  tables,  of  the  recipe 
preparation,  and  of  the  food  Intake  data.  Using  food  coiq>osltlon  tables  to 
analyze  food  Intake  data  Is  not  as  accurate  as  chemical  analysis;  however, 
these  values  provide  a  useful  average  for  population  studies,  do  not  delay 
data  processing,  and  Is  relatively  Inexpensive.  Using  MVEM  and  observing 
recipe  preparation  procedures  Improve  the  accuracy  of  nutritional  analysis 
Information  for  population  dietary  assessments. 
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APPENDICES 


APPENDIX  A 


DEFINITIONS  AND  ABBREVIATIONS 


ACCURACY  -  measurement  of  the  ability  of  the  data  collector  to  accurately 
estimate  portion  sizes  and  Is  determined  by  subtracting  the  estimated 
fraction  of  a  standard  from  the  fraction  obtained  from  weighing  the  food 
sample.  Criteria  for  accuracy  is  a  mean  difference  less  than  a  tenth  of  a 
fraction  of  the  standard  portion. 

ANALYZE  -  program  which  accesses  the  nutrient  database  to  compute  the 
nutrients  contributed  by  each  food  consumed  at  each  meal  by  each  person. 

OUTSIDE  FOODS  -  foods  that  are  eaten  at  times  and  locations  other  than  when 
data  Is  being  collected  during  meal  hours  In  the  dining  facility.  May 
Include  major  meals  and  fast  foods  that  are  eaten  In  place  of  dining  facility 
meals. 

CODEXVAX  -  program  ^dilch  Interactively  calls  up  Ingredient  names  to  assist  In 
coding  recipes. 

CODEX  -  name  of  the  computer  file  that  contains  an  Index  of  all  the  foods  and 
Ingredients  In  the  University  of  Massachusetts  database  with  an  assigned  slx- 
dlglt  number  assigned  to  each  Item. 

CODING  -  program  employed  to  Interactively  code  recipes.  CODING  accesses  a 
file  of  Ingredient  names,  NDB  codes,  and  portion  options,  and  allows  for 
quick  and  easy  coding  of  the  most  coaq>lex  recipes.  CODING  can  also  be  used 
as  a  data  entry  program,  with  the  actual  coding  being  done  with  a  printed 
version  of  the  Ingredient  file.  The  resulting  file  Is  appended  to  the  file 
containing  the  previously  coded  recipes. 

CODMAKER.FOR  -  program  which  creates  a  computer  file  consisting  of  the  six- 
digit  recipe  code,  a  food  description,  a  standard  weight  for  those  foods 
which  have  been  weighed  at  this  point,  and  a  three-character  access  code. 
CODMAKER  reads  the  coded  recipe  file  and  writes  a  studyname.COD  file  which  Is 
composed  of  the  three-character  access  code,  the  food  description,  and  the 
standard  weight.  CODMAKER.FOR  can  also  read  a  studyname.COD  file  from 
another  study  and  reformat  It.  CODMAKER  allows  the  recipe  specialist  to 
reorganize  the  studyname.COD  file  Into  categories  for  easy  reference. 

However,  subsequent  entries  cannot  be  added  to  the  previously  set  categories. 

CFFS-FDTE  -  Combat  Field  Feeding  System-Force  Development  Test  and 
Experimentation;  project  to  evaluate  the  Combat  Field  Feeding  System’s 
capability  to  provide  subsistence  support  to  the  Army  In  the  field  and  to 
evaluate  the  nutritional  adequacy  of  the  rations  consumed  by  soldiers  In  a 
field  environment. 

CYBER  -  name  of  University  of  Massachusetts*  computer 
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CYBEROIET  >  program  on  the  VAX  used  to  enter  pre-coded  between-meal  data  Into 
a  coiqiuter  file. 

EOT  -  editor  to  alter  USARIEM  computer  files  on  the  VAX. 

ENTRY  -  program  for  entering  food  Intake  data  into  a  coiq>uter  file.  The 
program  prompts  the  enterer  for  the  food's  access  code,  the  multiple  or 
fraction  of  the  standard  portion  served  and  returned,  and  the  percentage  of 
total  salt,  if  any,  applied  to  that  item.  ENTRY  accesses  the  studyname . COD 
file,  keying  on  the  three-character  access  code,  and  writes  a  data  file 
containing  the  subject  number,  the  day  number,  the  meal  number,  the  access 
code,  the  recipe  code,  the  food  name,  the  standard  weight,  the  number  of 
standard  portions  served,  the  number  of  standard  portions  returned,  the 
weight  of  food  consumed,  and  the  percentages  of  total  salt  added  to  any  food 
item.  A  report  file  is  generated  by  ENTRY  idilch  allows  the  data  collectors 
to  validate  their  work  against  the  original  data. 

GET_RECIPE  -  program  which  searches  sorted  files  of  previously  coded  recipes 
for  requested  recipes.  GET_RECIPE  writes  five  files,  one  containing  all 
previously  coded  recipes  that  are  sought,  another  containing  the  codes  of 
those  single  ingredient  recipes  found  in  the  ORACLE  table  NHOLE,  another 
containing  the  codes  of  special  Army  rations  found  in  the  ORACLE  table 
RATION,  and  two  list  files  containing  the  recipe  codes  that  were  found  and 
those  that  were  not  found. 

MVEM  -  Hodified  Visual  Estimation  Method;  Technique  of  determining  food 
volume  by  visually  comparing  to  a  weighed  standard  portion. 

NOB  -  Nutrient  Databank  is  a  standard  version  of  a  conq>uterlzed  nutrient 
database  tdiich  belongs  to  the  University  of  Massachusetts,  Amherst,  MA 
(UMASS)  and  which  is  used  to  compute  nutrient  composition  of  recipes  prepared 
in  Army  dining  facilities. 

ORACLE  -  a  database  management  program  which  is  available  on  the  VAX 
computer.  It  contains  the  nutrient  factor  file  for  the  Military  Nutrition 
Division. 

PC  -  Personal  Computer;  portable  stand  alone  Professional  350  conq>uter  which 
is  transported  to  a  study  site.  Contains  a  food  Intake  data  entry  program, 
recipe  entry  program,  data  collector  training  entry  program,  and  outside  food 
data  entry  program. 

PLATE  WASTE  -  food  remaining  on  a  subject’s  plate  after  the  meal  is  eaten. 

RATION  -  ORACLE  file  that  contains  nutritional  conq>osltlon  tables  for  Army 
developed  rations  such  as  MREs,  T-rations,  etc. 

RNE  -  Reason  Not  Eaten  -  reason  supplied  by  test  subject  at  end  of  meal  when 
food  is  not  consumed. 


RECIPED  FOODS  -  Foods  made  from  recipes  containing  multiple  ingredients. 


RECIPE. FIL  -  The  list  of  codes  for  all  Ingredients  and  the  quantity  of  that 
Ingredient  In  a  recipe.  Produced  by  the  GET_RECIPE  or  CODING  programs. 

RECIPE  SPECIALIST  -  person  with  a  nutrition  or  dietetics  background  \Aio 
collects  data  on  food  preparation  In  the  kitchen.  Major  duties  Include 
walghlng  Ingredients  and  final  yields  for  reclped  foods.  Observes  food 
preparation  methods. 

RELIABILITY  -  measures  the  extent  to  which  a  test  or  Judge  yields  the  same 
results  on  repeated  trials.  Measurement  always  contains  a  certain  amount  of 
chance  error  therefore  error-free  measurement  Is  never  attained.  While 
repeated  measurements  of  the  same  phenomenon  never  precisely  duplicate  each 
other,  they  do  tend  to  be  consistent  from  measurement  to  measurement.  This 
tendency  toward  consistency  found  In  repeated  measurements  of  the  same 
phenomenon  Is  referred  to  as  reliability.  The  more  consistent  the  results 
given  by  repeated  measurements,  the  higher  the  reliability  of  the  measuring 
procedure;  the  less  consistent  the  results,  the  lower  the  reliability. 

SPSSx  -  Statistical  Packages  for  Social  Sciences;  coiiq> rehens Ive  set  of 
programs  to  manage  and  statistically  analyze  data. 

Studyname . COD  -  a  computer  file  created  by  CODMAKER.FOR  for  a  specific  study 
tdilch  Is  composed  of  the  three-character  access  code,  the  food  description, 
and  the  standard  weights  of  foods  used  In  that  particular  study.  The 
studyname. COD  file  serves  two  purposes.  The  data  collectors  use  the  three- 
character  access  codes  Instead  of  the  slx-dlglt  USDA  codes  to  code  the  food 
Intake  data  because  It  reduces  the  possibilities  of  error.  The  studyname . COD 
file  also  serves  as  a  resource  file  for  the  data  entry  program,  translating 
the  access  code  Into  the  NDB  code,  and  the  number  of  portions  Into  weight  In 
grams. 

TWISTER  -  program  on  CYBER  computer  that  converts  portion  letters  and  amounts 
to  gram  weights. 

UMASS  -  University  of  Massachusetts,  Amherst,  MA. 

VAX  -  name  of  USARIEM  computer  which  Is  a  Digital  VAXl 1/780. 


APPENDIX  B 

PROCEDURES  FOR  TRAINING  DATA  COLLECTORS  IN  THE 
MODIFIED  VISUAL  ESTIMATION  METHOD  (MVEM) 
SESSION  I  (4-5  Hours) 


Preparation;  (2  Hours) 

1.  Select  food  items  to  train  and  test  the  data  collectors  from  the  list  of 
foods  in  Appendix  C.  The  list  is  coi)q>osed  of  foods  that  are  representative 
of  the  different  types  of  foods  that  are  served.  If  cooked  foods  are  not 
available,  dried  beans,  rice,  etc.  can  be  used  for  practice  in  estimating 
portion  sizes. 

2.  Determine  a  standard  portion  gram  weight  for  each  food  using  the  master 
list  in  ^pendix  D,  Table  1  as  an  exan^le. 

3.  Using  a  food  scale,  weigh  a  standard  portion  for  each  food  item  and  place 
each  standard  portion  on  its  own  plate. 

4.  For  each  food  item,  select  (maximum  of  6)  various  tenths  of  a  portion  of 
the  standard  (i.e.,  0.1,  0.2,  0.5,  2,  1.8)  and  compute  the  fraction  weight. 

a.  Using  a  food  scale,  weigh  the  fraction  weights  for  each  item. 

b.  Place  each  food  portion  on  a  separate  plate. 

c.  Record  the  gram  weight  and  the  tenth  of  standard  for  each  food  item 
on  a  card  with  an  ID  number  that  corresponds  to  an  ID  number  taped  to  the 
underside  of  each  plate  for  reference.  Place  cards  under  the  plates. 

5.  Utilizing  8  oz  paper  cups,  weigh  colored  water  on  the  food  scale  in  1.0 
oz  increments  without  ice;  measurement  will  be  indicated  on  a  card  placed 
under  each  cup  as  explained  for  plates. 

6.  Utilizing  various  quantities  of  cubed  ice  (i.e.,  1/4,  1/2,  3/4  C),  add 
ice  to  8  oz  paper  cups  and  then,  using  food  scale,  weigh  various  ounce 
measures  of  colored  water.  Ice  and  varying  quantities  of  liquids  will  be 
indicated  on  cards  placed  under  each  cup,  as  explained  in  the  section  on 
plates. 

7.  Repeat  step  5  utilizing  crushed  ice. 

Training  Exercise;  Visual  Estimation  Exercise  (1-2  Hours) 

1*  Place  different  foods  and  beverages  on  separate  tables  and  arrange  the 
following  practice  situations: 

(a)  The  trainee  will  visually  obseirve  the  different  standard  portions  of 
a  food  or  beverage  item  and  estimate  the  respective  fractional  portions. 
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(b)  Training  will  Involva  arranging  tha  plates  In  Increasing  order  of 
size  and  estimating  the  tenth  of  standard. 

(c)  The  trainee  will  match  the  two  portions  that  are  the  same  size. 

(d)  Place  a  standard  portion  on  a  plate  and  the  same  standard  portion  In 
a  bowl  and  have  the  trainee  select  the  matching  portion  from  the  fractional 
portions  In  different  bowls.  Trainee  will  also  estimate  the  tenth  of 
standard  for  each  portion. 

(e)  One  standard  portion  and  several  small  leftover  portions  will  be 
exhibited  for  the  trainee  to  estimate  the  tenth  of  standard  for  each. 

(f)  Other  training  situations  may  be  developed  as  needed.  The  above 
situations  may  be  altered  by  heaping  or  spreading  foods  to  change  the 
appearance. 

2.  The  trainee  can  look  at  the  cards  under  the  plates  for  Immediate  feedback 
on  accuracy.  The  trainer  will  make  sure  that  the  cards  are  returned  to  the 
right  plate  after  a  trainee  has  finished  working  at  each  table  by  siatchlng  ID 
numbers  and  then  will  rearrange  the  plates. 

3.  The  training  exercise  should  be  repeated  several  times  until  the  trainees 
are  comfortable  with  visually  estimating  portion  sizes. 


Testing  Exercise  (1  Hour) 

1.  Reorder  the  position  of  each  plate/cup  for  each  food/beverage  Item  and 
place  a  numbered  card  In  front  of  each  plate,  utilizing  the  master  list 
(Appendix  D)  which  also  contains  the  corresponding  card  numbers  for  each  food 
portion. 

2.  Trainee  will  visually  estimate  the  fractional  portion  size  of  each  Item 
comparing  each  to  Its  respective  standard  portion. 

3.  Review  with  trainees  their  judgments  for  each  plate. 

4.  Trainees  will  Indicate  their  error(s)  by  marking  the  correct  answer  for 
each  Item  next  to  his/her  Incorrect  estlmatlon(s) .  The  original  estimations 
should  not  be  changed  since  this  data  will  be  used  to  evaluate  the  trainees 
reliability  and  accuracy. 

5.  Trainees  may  review  any  errors  and/or  review  the  foods /beverages  for 
repeated  exposure  to  portion  sizes,  utilizing  the  ID  cards  under  each 
plate/cup. 


6.  Collect  trainees  data  form. 

7.  Wrap  up  food  portions  for  use  In  Session  II. 


SESSION  III  (A  Hours) 


Preparation;  (2  Hours) 

1.  Use  the  same  food  Items  as  In  Session  I  and  weigh  the  same  standard 
portion  weights  for  each  food  (Appendix  0,  Table  2). 

2.  Using  a  food  acalst  weigh  the  standard  portion  for  each  food  item  and 
place  each  food  item  onto  one  coo^artmcnted  paper  tray  or  dishes  that  will  be 
used  in  the  study. 

3.  Weigh  the  same  fractions  used  in  Session  I  of  each  food  item  and  place 
one  of  each  food  item  onto  a  compartmented  paper  tray  to  portray  a  typical 
meal  served. 

(a)  Prepare  3  trays  to  exen^lify  typical  meals  served. 

(b)  Prepare  3  trays  to  exenplify  typical  plate  waste. 

(c)  Number  each  tray  and  record  the  portion  weights  of  each  food  on  that 


Training/Testing  Exercise;  ( 2  Hours ) 

1.  Trainees  will  visually  estimate  the  fractions  of  each  food  item  on  each 
tray,  using  the  standard  tray  for  reference. 

2.  After  each  tray  has  been  viewed  by  all  trainees,  the  data  forms  will  be 
collected  to  analyze  for  reliability  and  accuracy.  Criteria  for  acceptable 
tellablllty  scores  is  >902.  The  mean  of  the  differences  between  the 
estimated  and  actual  fractions  will  be  used  to  determine  the  accuracy  of  the 
trainee. 

3.  Repeat  Session  I  Training  Exercise  or  allow  trainees  to  practice 
measuring  ice/llqulds  or  different  food  items  on  food  scale  themselves. 

A.  Rearrange  or  replace  the  foods  and  repeat  steps  1  and  2. 

5.  At  the  end  of  the  session,  review  the  portion  sizes  in  the 
compartmented  trays  with  the  trainees. 


SESSION  IV 


Repeat  the  Training/Testing  Exercise  o£ 
the  >901  reliability  score,  start  on  Se 


5 


SESSION  V  (4  Hours) 


Preparation;  (2  Hours) 

1.  Select  food  Items  comnxjnly  served  over /under  other  food  items  (le: 
creamed  beef  and  scrambled  eggs)  from  Appendix  C  and  determine  standard 
portions  for  each  food  as  shown  in  Appendix  D,  Table  3. 

2.  Weigh  the  standard  portion  for  each  food  Item  and  place  each  food  onto 
one  compartmented  paper  tray,  with  one  food  item  per  compartment  or  onto 
other  dishes  that  will  be  used  during  the  study. 

3.  Weigh  a  second  standard  portion  for  each  food  and  strategically  place 
food  Items  onto  a  compartmented  paper  tray  with  food  Items  covering  all  or 
part  of  other  Items  as  may  be  encountered  on  a  typical  tray. 

4.  Weigh  a  third  standard  portion  of  the  foods  listed  In  Appendix  D,  Table  4 
and  place  the  Items  In  bowls  as  may  be  encountered  at  a  typical  meal  service. 

5.  '  Weigh  various  fractions  of  the  different  foods  (Appendix  D,  Table  4)  and 
place  In  bowls. 

6.  Weigh  varying  fractions  of  the  standard  portions  for  each  food  Item  and 
place  In  compartmented  paper  trays  with  various  food  Items  hidden  to  portray 
a  typical  meal  served. 

(a)  Number  each  tray  and  record  the  portion  weight  of  each  food  on  the 


(b)  Prepare  3  trays  to  exemplify  t:rplcal  servings. 

(c)  Prepare  3  trays  to  exemplify  typical  plate  waste. 


Testing  Exercise;  (2  Hours) 

Follow  the  Testing  Exercise  procedures  of  Session  I. 


APPENDIX  C 


FOODS  TO  BE  USED  FOR  TRAINING  OF  PORTION  ESTIMATION 
BY  VISUAL  ESTIMATION 


SESSIONS  I-IV 


Peas  &  carrots  or  other  diced  vegetable 

Spanish  rice  or  other  rice 

Beef  stew  or  other  casserole  type  dish 

Brownle/Nutcake  or  other  baked  product 

Beverage  -  water 

Salt  or  sugar  packets 


SESSIONS  V-VI  (Bowl) 

Creamed  ground  beef 
White  rice 

Cake 

Blueberry  dessert 

Apple  cake  or  bread 
Maple  syrup 

Pot  Roast  or  other  sliced  meat  with  gravy 

Creamed  Beef 
Creamed  corn 
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TABLE  1 

PORTION  ESTIMATION  BY  VISUAL  ESTIMATION 
MASTER  LIST  FOR  SESSIONS  I  AND  II 


FOOD 

ITEM 

STANDARD 
PORTION  (g) 

FRACTIONAL 
PORTION  (g) 

TENTH  OF 
STANDARD 

ID  NO. 

PLATE  NO 

Beef 

Stew 

250 

62 

0.25 

A 

6 

125 

0.50 

B 

1 

200 

0.80 

C 

4 

250 

1.00 

D 

3 

275 

1.10 

E 

2 

325 

1.30 

F 

5 

Spanish  Rice 

150 

45 

0.30 

A 

1 

60 

0.40 

B 

6 

75 

0.50 

C 

3 

90 

0.60 

D 

5 

105 

0.70 

E 

2 

120 

0.80 

F 

4 

Peas 

&  Carrots  100 

75 

0.75 

A 

2 

90 

0.90 

B 

4 

30 

0.30 

C 

6 

75 

0.75 

D 

5 

10 

0.10 

E 

3 

20 

0.20 

F 

1 

Brownie 

100 

5 

0.05 

A 

4 

10 

0.10 

B 

3 

25 

0.25 

C 

5 

30 

0.3C 

D 

6 

40 

0.40 

E 

1 

50 

0.50 

F 

2 

Salt 

4 

0 

0.00 

A 

3 

.40 

0.10 

B 

4 

1 

0.25 

C 

6 

2 

0.50 

D 

5 

3 

0.75 

E 

2 

4 

1.00 

F 

1 
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W-.  r  -  if  , 


eiwwwwviasi 


FOOD 

ITEM 


APPENDIX  D,  TABLE  1  (continued) 
PORTION  ESTIMATION  BY  VISUAL  ESTIMATION 
MASTER  LIST  FOR  SESSIONS  I  AND  II 


STANDARD 
PORTION  (g) 


FRACTIONAL 
PORTION  (g) 


TENTH  OF 
STANDARD 


ID  NO. 


PLATE  NO 


APPENDIX  0 
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TABLE  2 

PORTION  ESTIMATION  BY  VISUAL  ESTIMATION 
MASTER  LIST  FOR  SESSIONS  III  AND  IV 


TRAY  NO. 


FOOD  ITEM 


STANDARD 
PORTION  (g) 


FRACTIONAL 
PORTION  (g) 


TENTH  OF 
STANDARD 


Standard 

Baaf  Stev 
Spanish  Rice 
Peas  &  Carrots 
Brownie 

Salt 

Water 

1 

Beef  Stew 
Spanish  Rice 
Peas  &  Carrots 
Brownie 

Salt 

Water 

2 

Beef  Stew 
Spanish  Rice 
Peas  &  Carrots 
Brownie 

Salt 

Water 

3 

Beef  Stew 
Spanish  Rice 
Peas  &  Carrots 
Brownie 

Salt 

Water 

A 

Beef  Stew 
Spanish  Rice 
Peas  &  Carrots 
Brownie 

APPENDIX  D,  TABLE  2  (continued) 
PORTION  ESTIMATION  BY  VISUAL  ESTIMATION 
MASTER  LIST  FOR  SESSIONS  III  AND  IV 


TRAY  NO. 


FOOD  ITEM 


STANDARD 
PORTION  (g) 


FRACTIONAL 
PORTION  (g) 


TENTH  OF 
STANDARD 


APPENDIX  D,  TABLE  3  (continued) 
PORTION  ESTIMATION  BY  VISUAL  ESTIMATION 
MASTER  LIST  FOR  SESSIONS  V  AND  VI 


FOOD  ITEM 


STANDARD 
PORTION  (g) 


FRACTIONAL 
PORTION  (g) 


TENTH  OF 
STANDARD 


APPENDIX  D 
TABLE  4 

PORTION  ESTIMATION  BY  VISUAL  ESTIMATION 
MASTER  LIST  FOR  SESSIONS  V  AND  VI 


FOOD  ITEM  STANDARD  FRACTIONAL  TENTH  OF 

PORTION  (g)  PORTION  (g)  STANDARD 


APPENDIX  E 


DATA  COLLECTION  AND  THE  SWs 


Much  can  be  overlooked  by  e  date  collector  uhen  a  test  subject  presents 
his/her  tray  for  evaluation,  whether  In  a  quiet  dining  facility,  or  out  on  a 
rainy,  dark,  remote  field  site.  Portion  estimation  by  direct  observation 
requires:  two  trained  eyes  and  a  repertoire  of  questions. 

The  SWs  are  guidelines  and  hints  for  data  collection  efforts  to  help 
obtain  the  best  quality  data  possible. 

I.  Who;  For  each  test  subject. 

II.  What ; 

A.  Foods  t 

(1)  What  type  of  food  (l.e.,  rye  vs.  whole  wheat  bread). 

(2)  What  amount  of  a  food  Item  was  served  (l.e.,  how  many  pieces, 
scoops,  ladles,  etc.  In  tenths  of  standards). 

(3)  What,  and  how  much,  did  test  subject  eat  from  his  tray  (l.e., 
french  fries)  before  showing  tray  to  data  collector  (l.e..  In  tray-llne; 
waiting  for  data  collector). 

(A)  What,  and  how  much  of  each  Ingredient  Is  In  a  salad-bar  salad 
(l.e.,  have  test  subject  dissect  salad). 

B.  Sandwiches ; 

(1)  What  type  of  sandwich  filler  (l.e.,  tuna  salad  vs  chicken  salad) 

(2)  What  type  of  bread/roll  (l.e.,  rye  vs  vdiole  wheat). 

(3)  What  amount  of  sandwich  meat  used  (l.e.,  how  many  slices, 

scoops) . 

(A)  What  spread  was  put  on  bread  (l.e.,  mayonnaise,  mustard,  etc.) 
and  how  much  (l.e.,  heaping  tsp,  1  T,  etc.). 

(5)  What  else  Is  In  sandwich  (l.e.,  cheese,  lettuce,  tomato,  onion, 
etc.)  and  how  much  of  each. 

C.  Beverages : 

(1)  What  type  of: 

(a)  soda  (sugar  free  vs  sugared) 

(b)  milk  (IZ,  2Z,  whole,  chocolate,  mix  of  white  &  chocolate) 


(c)  koolade  (sweetened  vs  unsweetened) 

(d)  juice  (orange  Juice  vs  orange  Juice  mixed  with  grapefruit) 

(e)  coffee  (caffelnated  or  decaffeinated) 

(2)  What  type  of  milk,  cream,  nondairy  creamer  was  used  in 
coffee/tea. 

(3)  What  type  and  amount  of  aweetener  was  added  to  coffee/tea,  (le: 
sugar  2t;  equal  1  pkt). 

(A)  What  amount  of  beverage  was  drunk  while  filling  the  glass  and/or 
tdille  waiting  for  the  data  collector. 

(5)  What  amount  of  beverage  was  used  to  refill  the  glass  after 
drinking  at  the  machine. 

(6)  What  amount  of  ice  was  in  the  glass  and  what  type  (l.e.,  crushed 
vs  large  cubes).  How  much  ice  melted  when  the  beverage  was  added  (if  liquid 
warm/hot. ) 

D.  Condiments ; 

(1)  What  type  of  salad  dressing  (l.e.,  blue  cheese  vs  mayonnaise;  low 
calorie  Italian  vs  regular  Italian)  and  what  amount  (l.e.,  2  ladles,  2  pkts 
etc. ) . 

(2)  What  amount  of  packets  taken:  salt,  pepper,  sugar,  artificial 
sweetener,  nondairy  creamer,  syrup.  Jelly,  peanut  butter. 

(3)  What  kind  of  fat  patties:  butter  or  margarine,  and  how  many. 

III.  Where:  Could  there  be  other  food  items  that  are  not  readily  seen? 

A.  Under  other  foods 


beef? 


(1)  Under  creamed  beef  could  be  found: 

(a)  white  rice 

(b)  biscuit 

(c)  scrambled  egg 

(d)  fried  eggs 

(e)  etc. 

(f)  How  many  pieces,  ladles,  scoops  of  these  foods  are  under  the 


(2)  Any  food  item  may  be  hidden  by  another  food  item  on  the  same 
plate  (l.e.,  toast  covering  bacon,  margarine  patties  covering  salt  packets, 
chicken  ala  king  over  mashed  potatoes,  etc). 

(3)  Sandwiches  must  be  carefully  dissected  to  obtain  data  on  unseen 
filler,  spread,  vegetables,  etc. 

(4)  Self-made  salads  must  be  carefully  dissected  to  obtain  data  on 
hidden  food  items /dressings. 


(5)  Gravies,  sauces,  toppings  may  cover  food  items.  Ask. 

B.  In  Test  Subject’s  Uniform  Pockets 

(1)  fresh  fruit 

(2)  milk  cartons 

(3)  condiments 

(4)  bag  of  chips,  etc. 

C.  In  Test  Subject’s  Hand 

(1)  saate  as  above 

D.  NEVER  TOUCH  A  TEST  SUBJECTS  POODI  ASK  HIM/HER  TO  MOVE  IT  (l.e.,  top 
slice  of  sandwich;  toast  over  plate,  etc.). 

IV.  W^en 

A.  After  test  subject  has  obtained  all  foods /beverages  and  before  he/she 
begins  to  eat/drlnk,  obtain  the  "What  II  A>D"  and  "Where  II  A-C"  listed  above 
for  each  "Who". 

B.  When  test  subject  has  completed  his/her  meal  and  before  discarding 
tray,  obtain  the  following  Information: 

(1)  Was  any  food/beverage  consumed  that  was  not  originally  shown  to 
data  collector  (l.e.,  seconds;  trading)  and  how  much  of  each. 

(2)  What  food/beverage  originally  accounted  for  was:  spilled?;  given 
away?;  thrown  out  accidentally?;  fell?;  etc. 

(3)  Were  any  additional  condiments  added  to  food/beverage, (l.e. : 
salt  from  shaker,  herb  mix,  hot  sauce,  etc.) 

(4)  What  rating  (1-9)  does  test  subject  assign  each  food/beverage 
consumed  at  that  meal  (when  applicable). 

V.  Wvy 

If  a  test  subject  does  not  eat/flnlsh  a  food  Item  that  he/she  originally 
had  on  tray,  he/she  must  be  asked  "why?"  or  for  a  reason  not  eaten  (RNE)  l.e., 
tasted  bad,  wasn’t  hungry,  full,  cold,  etc.  If  ^  0.05  left  over  (a  scrap)  It 
can  be  concluded  that  test  subject  was  "done  with  meal",  and  does  not  have  to 
be  asked.  For  a  portion  returned  2.  0.06  a  RNE  oust  be  obtained. 
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RATION  RECORD 
BREAKFAST/LUNCH/DINNER 


NAME :  _ 

SUBJECT  #: 


BREAKFAST  —  B 


MEAL:  (CIRCLE  ONE) 

LUNCH  —  L 


DATE :  _ _ 

DATA  COLLECTOR  #: 

DINNER  —  D 


1 

PORTION 

PORTION 

ADDED 

REASON  NOT 

RATING 

Si 

Jt 

•  DESCRIPTION 

t 

t 

CODE  # 

SERVED 

RETURNED 

SALT 

EATEN /NOT 
FINISHED 

CODE 

V*, 

NATICK  Foi 
1  Aug  87 


EDITION  DATED  I  Jan  87  IS  OBSOLETE. 


appendix  g 


VALIDATION  OF  FOOD  INTAKE  DATA 


Oblactlvi 
To  ensure  that: 

1.  Data  on  collection  £orms  accurately  reflects  actual  food  consumption. 


2.  Data  entered  by  computer  personnel  accurately  reflect  the  data  on  the 
collection  forms. 


3.  Data  used  for  statistical  analysis  are  without  error  so  that  results 
will  be  accurately  presented  In  the  final  test  report. 


Procedure: 


A.  Post-Meal  Validation 


1.  Each  data  collector  Is  responsible  for  completing  and  reviewing 
his/her  respective  data  collection  forms  after  each  meal  ensuring  that  all 
forms  Include: 


(*) 

(b) 

(c) 

(d) 

(e) 

(f) 

(g) 


Test  Subject  Name 
Corresponding  Test  Subject  Number 
Data  Collectors  Initials 
Teat  Date 
Ration  Type 
Data  Collection  Meal 

Food  codes  corresponding  to  food  Items  served;  codes  obtained 
from  Recipe  Specialist. 

(h)  Appropriate  serving  sizes  for  all  foods  selected,  In  tenths  of 
the  standard  portion.  For  those  food  items  for  which  standard  portions  are 
not  provided  for  visual  observation,  consult  standard  portion/code  printout, 
(l.e.,  normally  1  T  catsup  -  1  serving;  however  If  a  2  oz  ladle  -  1  serving, 
then  1  T  catsup  >  0.25  serving. 

(I)  A  portion  returned  (PR)  must  be  Indicated  for  each  food  Item 
selected.  If  a  test  subject  ate  all  of  a  food  Item  PR*0. 

(J)  Appropriate  conversions  of  all  fractions  Into  decimals  (l.e.,  1/8 
>  .13,  etc.). 

(k)  Portion  sizes  served  and  returned,  any  conversion  factors  (cf) 
and  mathematically  generated  data  are  each  present,  legible,  and  accurate 
(l.e.,  cake  ■  1.0  x  .85  cf  ■  .85  ;  frosting  -  0.5  x  .32  cf  ■  .16.  Portions 
returned  must  also  be  multiplied  by  appropriate  conversion  factor,  as  above, 
when  appropriate. 

(l)  Added  salt  Indicated  and  quantified  when  appropriate. 

(m)  Appropriate  Reason  Not  Eaten  (RNE)  coded  when  any  food  portion 
returned  (l.e..  If  PR  ^  .05,  then  RNE  «  "done  with  meal"  since  for  each  PR  an 
RNE  must  be  Indicated)  otherwise  RNE  >  cold;  taste  bad;  didn’t  want,  etc). 
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(n)  Food  ratings  must  b«  present  for  all  food  Items  with  the 
exception  of:  sugar,  salt,  pepper,  nondairy  creamer,  catsup. 

2.  All  data  collection  forms  should  be  presented  to  appropriate  data 
enterer  after  each  meal  In  a  manllla  folder  which  Indicates:  study,  data 
collector’s  name,  date,  meal  (l.e..  Fort  Validate,  Val  Major,  Mon.,  25  Jan  87, 
lunch) . 

B.  Post-Entry  Validation 

1.  Each  data  collector  Is  responsible  for  reviewing  the  computer  report 
generated  by  the  data  enterer  to  be  sure  that  It  Is  accurate. 

2.  Computer  reports  are  compared  to  data  collection  forms  to  confirm 
accurate  entry  of  all  Information/data. 

3.  Compare  the  food  descriptions  on  the  computer  reports  to  that  on  the 
data  collection  form  to  ensure  accuracy  of  data,  and  as  a  double  check  against 
use  of  Incorrect  food  code(s). 

A.  Errors  found  on  the  computer  report  should  be  corrected  using  colored 
Ink  and  circled  to  assure  visibility. 

5.  If  an  error  Is  found  on  the  computer  report,  then  the  original  error 
must  also  be  corrected  In  colored  Ink  and  Initialed  on  the  original  data  form. 

6.  Folders  are  to  be  returned  to  data  enterer  for  correction  after  data 
Is  validated;  validation  errors  are  to  be  Indicated  on  front  cover  (l.e.,  1st 
validation  -  errors  -  3  or  A  or  5,  etc.;  2nd  validation  -  errors  -  2,  etc.) 

C.  When  all  corrections  have  been  made  and  data  Is  "clean",  compare  original 
data  forms  to  "clean"  computer  report  to  Insure  that  no  other  errors  were  made 
Inadvertently  In  the  data  entry  process. 

D.  If  the  Project  Leader  has  validated  or  spot-checked  data  and  found  errors, 
please  review  findings  to  confirm  Interpretation  of  data. 

E.  When  all  correctlons/valldatlon  have  been  done.  Indicate  on  front  cover  of 
folder,  FINAL:  CLEAN. 

Helpful  Suggestions 

1.  Go  slowly  I  "Haste"  ■  Errors. 

2.  Use  rulers  so  lines  are  not  Inadvertently  skipped. 

3.  Validate  with  another  data  collector  so  that  one  reviews  the  computer 
prlnt-out  and  the  other  reviews  the  original  data  forms. 
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A.  Count  the  number  of  Items  per  meal  on  prlnt-out  and  data  forms  to  double 
check  that  no  foods  have  been  excluded  or  entered  twice. 
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